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INTRODUCTION 



I . 

As the costs of health care continue to spiral ever upward, 
the public has begun to ask questions, and through its elected 
representatives, demand answers, about health care in the 
United States. This has been particularly true in the public 
sector, including the uniformed military services, where health 
care is financed through collection of taxes and creation of 
public debt. 

The public is beginning to demand accountability for 
government's use of budgetary assets. The who, what, when, 
where, and how of publicly financed health care services is 
being questioned at virtually every level of government. 

The answers to many of these questions have been legislated 
through our system of laws and regulations. [Ref. 1-2] Others 
come from currently accepted professional practices, current 
technology, and the availability of resources. Some seem to 
have no generally accepted answers, a fact that is a bother- 
some and multifaceted problem in itself. 

First, because of the highly qualitative and multidimen- 
sional nature of health care, there has been little agreement 
on an operational definition of health. An acceptable 
definition of health would have to reflect social preferences 
toward various functional levels: social, mental, and physical 

the relative importance of diseases and disabilities; the 
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likelihood of occurrence of different diseases and disabili- 
ties; and the prognosis associated with each disease and 
disability. [Ref. 3] Concurrence, even on these facets, has 
been difficult to achieve. 

Second, because health is multidimensional, it cannot be 
actually measured, only inferred. Specific components of 
health, once identified, must be defined, measured to the 
extent possible, and relative weights, representing social 
and clinical values, assigned. These separate components of 
health may be considered as individual indicators of health 
and combined to form an index of general health status. Once 
an index of health status has been conceptualized, developed, 
and operationalized, it may be used to indicate relative levels 
of health in both individuals and populations; serve as a 
measure of the effectiveness of health care systems; and 
serve as a single component of individual measures of 
accountability, efficiency, effectiveness, productivity, 
quality, etc. [Ref. 4-6] 

Neither of these two major issues are easily resolved, 
however, and a fair body of literature now exists discussing 
conceptual and methodological problems inherent in the 
development and use of health status indexes. Two major 
problems that seem to be pervasive throughout the literature 
are the tendency to conceptualize health in all encompassing 
definitions, making measurement difficult; and the tendency 
to try and develop mathematical formulas and models which 
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will capture all components of health, yet are so complex 
they are rendered unusable for most practitioners and 
managers. [Ref. 7-11] 

These problems, however, have not deterred researchers, 
practitioners, and decision makers, particularly within the 
public health sector, from searching for such measures. 

This thesis represents a further attempt to find and 
evaluate a health status index, primarily for oral health, 
for use within the naval health care arena, capable of 
meeting the needs of clinicians, administrators, and public 
decision makers alike. 

The first step in this attempt to find a suitable oral 
health index was an examination of past research and clinical 
practices through a review of relevant literature. This 
review of pertinent literature provides the substance of the 
following chapter. 
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II - LITERATURE REVIEW 



As can be seen from the bibliography, there is a wealth 
of literature available pertaining to health indexes. To 
provide some semblance of order in reviewing the literature, 
indexes directed primarily toward general health issues will 
be discussed first, followed by a survey of a wide range of 
indexes pertaining to oral health, a review of a number of 
more popular and widely accepted oral health indexes, and 
an examination of recent developments regarding oral health 
indexes . 

A. GENERAL HEALTH INDEXES 

General health indexes of a wide variety have been 
proposed to measure an individual's social and physical 
well-being [Ref. 12-13]; the overall health status of 
communities and general populations [Ref. 14-17]; implications 
and importance of various social and sociomedical factors in 
health care [Ref. 18-20]; unmet health care needs of individ- 
uals and populations [Ref. 21-22]; society's values and 
utilities of various conditions of life [Ref. 23-24]; quality 
of health care services and outcomes of health care interven- 
tions [Ref. 25-27]; priorities of health care programs in 
society and governmental agencies [Ref. 28]; effectiveness 
of health care programs in achieving desirable health care 
outcomes [Ref. 29-35]; utilization and resource allocation in 
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providing health care services and achieving desired health 
care outcomes [Ref. 36-37]; clinical, technological, social, 
political, and economic indicators for health care policy and 
research [Ref. 38]; clinical, technological, social, political, 
and economic indicators for health care planning [Ref. 39-41] ; 
morbidity and mortality [Ref. 42]; patient's preferences in 
obtaining health care services and achieving health care 
outcomes [Ref. 43]; impact of sickness on individuals, groups, 
and populations [Ref. 44-47]; seriousness of illness and its 
consequences, clinical as well as social [Ref. 48-49]; dis- 
ability and its consequences, for individuals as well as 
society [Ref. 50-52]; illness in the aged and its consequences, 
for individuals as well as society [Ref. 53]; and comprehen- 
sive health measures indicating specific health states 
[Ref. 54] . 

As can be seen above, a great deal of time and effort has 
been expended in attempts to develop a wide variety of general 
health status indexes . The vast majority of these indexes 
have been developed for special purposes, however, and are 
generally valid only under specific circumstances. None of 
them are universally accepted as general health status indexes, 
nor are they useful under the wide range of conditions and 
situations of interest to public health decision makers. 

This situation is no less problematic within the dental 
health sector, the area of principal concern for this thesis. 
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B. GENERAL ORAL HEALTH INDEXES 



As with indexes developed for evaluating general health 
states, a vast amount of literature is available regarding 
the development and utilization of indexes for a variety of 
conditions and situations relating to oral health. 

There are general oral health indexes developed for a wide 
range of epidemiological studies to examine the prevalence and 
incidence of oral disease and the oral health status of 
communities and populations [Ref. 55-60]; social and socio- 
dental factors associated with oral health of individuals and 
populations, particularly as related to influences of cultural 
and ecological factors [Ref. 61-63]; unmet dental health needs 
of individuals and populations in a variety of social and 
economic situations [Ref. 64-73]; dental health status and 
general satisfaction with specific dental conditions [Ref. 

74]; outcomes, appropriateness, and quality of oral health 
care services provided [Ref. 75-88]; efficiency and produc- 
tivity of dental health services [Ref. 89-91]; anxiety related 
to dental health care [Ref. 92]; and the needs of special 
populations such as the elderly and the military [Ref. 93-110]. 

C. SPECIFIC ORAL HEALTH INDEXES 

In addition to the general oral health indexes, there 
are a number of more specific oral health indexes that relate 
primarily to specific oral structures and tissues, clinical 
conditions, and diagnostic methodologies. There are indexes 
developed primarily for measurement of levels of oral hygiene 
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[Ref. 111-120]; the amount of soft accumulations, plaques, 
stains, and debris on dental structures [Ref. 121]; the amount 
of hard deposits and calculus on dental structures [Ref. 122- 
124]; the clinical condition, relative health, and pathologic 
states of the gingival structures [Ref. 125-135]; the number 
of carious lesions and decayed teeth [Ref. 136-153]; severity, 
incidence, prevalence, and consequences of periodontal disease 
[Ref. 154-199]; the degree of alveolar bone loss secondary to 
periodontal disease, as measured by periodontal pocket depth, 
radiographic analysis, and surgical determination [Ref. 200- 
205] ; the assessment of tooth mobility secondary to periodontal 
disease and alveolar bone loss [Ref. 206]; the loss of teeth 
secondary to disease and injury [Ref. 207]; the identification 
and scoring of occlusal disorders [Ref. 208-210]; the identi- 
fication of dental structures potentially requiring endodontic 
intervention [Ref. 211-212]; the identification of need, 
prioritization, and outcomes of orthodontic treatment [Ref. 
213-214] ; the use of radiographic methodologies in clinical 
diagnosis, prognosis, and follow-up of oral disease, injury, 
and treatment outcomes [Ref. 215-220]; and the use of complex 
mathematical, statistical, and computerized models to predict, 
evaluate, and monitor the need for clinical services, the 
outcome of dental intervention, and econometric measures of 
productivity [Ref. 221-230]. 
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D. WIDELY KNOWN ORAL HEALTH INDEXES 



A number of these indexes have been generally accepted, 
although often in only very restricted situations, and have 
been used in a wide variety of epidemiological studies: 

1 . The DMF Index 

The DMF (Decayed, Missing, or Filled) index, developed 
by Klein, Palmer, and Knutson, while studying the dental needs 
of elementary school children in Hagerstown, Maryland, during 
the late 1930's, provided the first and perhaps best known and 
most widely accepted, of the oral health indexes. [Ref. 2 31- 
234] 

The DMF index is based on ascertaining the number of 
teeth which are carious, missing, or restored (filled) . The 
index has been reported in at least two different methodolo- 
gies. First, the DMF index may be reported as the average 
number of DMF teeth per person examined. This is sometimes 
referred to as the DMFT (decayed, missing, or filled teeth) 
index. And, second, the DMF index may be reported as the 
average number of DMF tooth surfaces per person examined. 

This is sometimes referred to as the DMFS (decayed, missing, 
or filled surfaces) index. [Ref. 235] 

2 . The PMA Index 

The PMA (Papillary gingivae, Marginal gingivae, and 
Attached gingivae) index, developed by Schour and Massler 
during the late 1940 's, represented an attempt to provide a 
quantitative method of recording inflammatory changes in the 
gingivae. [Ref. 236-243] 
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The index is obtained by assessing the prevalence and 
severity of gingivitis and assigning numerical scores for 
each of three gingival areas for each tooth examined: the 
papillary gingivae, the marginal gingivae, and the attached 
gingivae. A score is established for each tooth and summed 
to provide a PMA index for an individual's mouth. Scores 
obtained for individuals may be summed and averaged to provide 
an epidemiological index for communities and populations. 

[Ref. 244] 

3 . Russell's Periodontal Index 

The periodontal index developed by Russell during the 
1950 's represented the first major attempt to provide a measure 
of periodontal disease for epidemiological studies. [Ref. 245- 
248] 

Each tooth examined is evaluated for clinical signs 
of periodontitis, particularly noting the usual progressive 
nature of the disease, inflammation of the gingivae followed 
by periodontal pocket formation and eventual loss of mastica- 
tory function. Each tooth is assigned a numerical score, the 
scores are summed for all teeth examined, and the total score 
is divided by the number of teeth examined. This average 
score represents the average conditions of the periodontal 
tissues and structures within a patient's mouth. [Ref. 249] 

4 . Ramfjord's Periodontal Index 

The periodontal index, developed by Ramf jord during 
the late 1950 's, represented another attempt to provide a 
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measure of periodontal disease for use in epidemiological 
studies. [Ref. 250-251] 

The index is accomplished by conducting a thorough 
examination of the periodontal status of six teeth, parti- 
cularly noting the condition of the gingivae, periodontal 
pocket depth, calculus and plaque deposits, attrition, 
mobility, and lack of contact. [Ref. 252] 

5 . Gingival-Bone Count 

The gingival-bone count, developed by Dunning and 
Leach during the late 1950 's, represented another attempt 
to provide a measure of periodontal disease for use in 
epidemiological studies. Of particular interest to the 
developers was the ability of an index to reflect both 
reversible signs of periodontal disease, primarily gingival 
changes, and irreversible sequelae of periodontal disease, 
primarily alveolar bone loss. [Ref. 253] 

The gingival-bone count is obtained by assessing the 
gingival status and bone loss of each tooth examined, a 
numerical score assigned for each tooth by combining the 
individual gingival scores and bone scores, and an average 
computed for the whole mouth. [Ref. 254] 

6 . Oral Hygiene Index (QHI) 

The oral hygiene index, developed by Green and 
Vermillion during the late 1950's, and subsequently modified 
to provide the simplified oral hygiene index (OHI-S) , repre- 
sented a further attempt to provide a measure of periodontal 
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disease for use in a wide range of epidemiological studies. 
[Ref. 255-257] 

The oral hygiene index is actually a combination of 
two separate indexes, the debris index and the calculus index. 
The debris index is obtained by evaluating the amount of debris 
on each of six preselected tooth surfaces and assigning a 
numerical score for each tooth. The individual tooth scores 
are summed and the total divided by the number of teeth 
examined. The calculus index is obtained similarly, 
evaluating each of the teeth for the presence of calculus. 

The oral hygiene index is then obtained by summing the debris 
index and the calculus index. [Ref. 258] 

7 . Gingival Index, Plaque Index, and Retention Index 

System 

The gingival index, plaque index, and the retention 
index, developed by Loe and Silness in the early 1960 's, 
represented another approach to the evaluation of periodontal 
disease epidemiology. [Refs. 259-260] 

The three indexes actually comprise a system for 
evaluating the clinical consequences of periodontal disease. 
[Ref. 261] 

The gingival index is entirely confined to the 
qualitative changes in the soft tissues of the gingivae. 

Each of four gingival areas of each tooth examined is 
assigned a numerical score, based upon clinical changes in 
the tissue, indicative of the degree of gingivitis present. 

The scores for the four areas are summed and divided by four 
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to obtain a gingival index for each tooth. The scores for 
each tooth are then summed and the total divided by the 
number of teeth examined to obtain a gingival index for the 
individual. [Ref. 261: pp . 610-613] 

The plaque index is confined to an evaluation of the 
amount of soft debris (plaque) which has accumulated on each 
of the four gingival areas previously evaluated for the 
gingival index. Each of the four gingival areas of each 
tooth examined is assigned a numerical score, based upon the 
amount of soft debris present. The plaque index is then 
calculated similarly to the gingival index. [Ref. 261: 
pp. 613-614] 

The retention index is based upon an evaluation of 
the degree of rough surfaces, such as caries, calculus, and 
imperfect restorations, available for accumulation (retention) 
of bacteria, which promote gingival disease, on each tooth 
previously evaluated for the gingival and plaque indexes. 

A numerical score is established for each tooth and the final 
retention index is calculated similarly to the gingival and 
plaque indexes. [Ref. 261: p. 614] 

8 . Calculus Surface Index 

The calculus surface index, developed by Ennerver, 
Sturzenberger , and Radike during the late 1950's, was an 
attempt to provide a scoring system for quantitating the 
accumulation of dental calculus in short-term testing 
programs. [Ref. 262] 
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Each of the mandibular incisors is considered on 
the basis of four surfaces, two proximals, one labial and 
one lingual. Upon examination, the number of tooth surfaces 
on which calculus had occurred is noted, and a numerical 
score, zero to four indicating the number of tooth surfaces 
involved, assigned. The totals for each tooth are summed. 

The calculus surface index is then the total number of tooth 
surfaces on which calculus had been detected. [Ref. 262: 
p. 54] 

9 . Navy Periodontal Screening Examination 

The Navy periodontal screening examination was 
implemented in 1968 to increase dentists' awareness of 
periodontal pathology, emphasize the importance of early 
diagnosis and treatment, and provide a tool for assessing 
patients' abilities and motivation for practicing health 
maintenance activities. [Refs. 263-268] 

The Navy periodontal screening examination is com- 
prised of two separate indexes: the Navy periodontal disease 

index and the Navy plaque index. Both indexes are conducted 
on six teeth, the same teeth as used in Ramfjord's periodontal 
index. [Ref. 263: p. 41] 

The Navy periodontal disease index (NPDI) is comprised 
of two separate parts as well: a gingival score which assesses 

gingival inflammation, as manifest by color, consistency, den- 
sity, enlargement, and bleeding tendencies, and a periodontal 
pocket score which assesses alveolar bone destruction as 
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determined by periodontal pocket depth. Combining these 
two scores provides the NPDI score for the individual tooth. 

The results are recorded in the patient's clinical record as 
the NPDI score (the highest score obtained for any individual 
tooth) and the NPDI total for the six teeth examined. [Ref. 
264: p. 63] 

The Navy plaque index (NPI) reflects the plaque 
control status of the individual, emphasizing bacterial 
plaque present on the cervical area of the tooth, in contact 
with the gingival margins, felt to be of greatest concern in 
periodontal disease. The results are recorded in the patient's 
clinical record as the NPI score (the highest score obtained 
for any individual tooth) and the NPI total for the six teeth 
examined. [Ref. 264: p. 63] 

E . RECENT ADVANCES 

These oral health indexes have been evaluated extensively 
in the literature. [Refs. 269-282] Many of the indexes, 
particularly those specific oral health indexes discussed 
above, have shown acceptance in specific and limited uses, 
generally those for which the indexes were initially devel- 
oped. As with the general health status indexes, however, 
there has been no universal acceptance of the use or value 
of the oral health indexes, particularly within the wide 
range of contexts of interest to clinicians, researchers, 
and decision makers . 
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A major step in the search for a comprehensive oral 
health status measure was accomplished by Nikias , Sollecito, 
and Fink in the late 1970's. [Refs. 283-284] 

In evaluating the many oral health status indexes in 
use, they noted that none of the measures, when employed 
separately, produced a reasonably accurate picture of total 
oral health. The need for one comprehensive index, capable 
of depicting all potentially significant disease processes, 
their interactions, and their consequences, was clearly 
stressed. They noted that, in addition to being able to 
summarize diverse clinical elements into one index, a com- 
prehensive oral health index should provide a meaningful 
concept of oral health status, expressed numerically, which 
would provide a statistical tool for use by clinicians, 
researchers, and decision makers alike, in a diverse range 
of situations. [Ref. 283: p. 148] 

Using data gathered from the examination of 1,290 adult 
members of the Health Insurance Plan of Greater New York 
(HIP) (a prepaid medical group practice) , Nikias and her 
coworkers developed composite profiles of oral health status 
composed of specific clinical oral conditions. Eight clinical 
oral conditions were initially analyzed for inclusion in a 
comprehensive profile of oral health status: (1) edentulous- 

ness (in both arches, or in one arch); (2) number of missing 
and unreplaced teeth; (3) levels of disease in gingival and 
periodontal tissues; (4) percent of decayed teeth; (5) oral 
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hygiene status; (6) number of healthy and untreated teeth; 

(7) number of filled teeth; and (8) number of replaced teeth. 
[Ref. 283r p. 150] These were subsequently reduced to four 
dimensions, with four levels of clinical severity in each: 

(1) missing teeth; (2) disease in gingival and periodontal 
tissues; (3) decayed teeth; and (4) oral hygiene status. 

[Ref. 283: p. 152] 

The principal finding of this initial work was that it 
appeared feasible to combine multiple oral diseases and 
conditions to provide a comprehensive measure of oral health 
status. It was felt that this comprehensive measure, once 
developed, would facilitate epidemiological comparisons or 
oral health status among populations, assessment of changes 
in oral health status over time, evaluation and planning of 
oral health programs, and meeting oral health needs of 
populations of interest. [Ref. 283: p. 158] 

After accomplishing the construction of comprehensive 
profiles of oral health status, Nikias and her coworkers 
took the next major step, that of attempting to combine the 
comprehensive profiles into one composite oral health index. 
The problem of just how to rank these comprehensive profiles 
in regard to relative oral health states was now addressed. 
The question to be answered, in considering only two patients 
for example, was that of, "which patient was in a better 
state of oral health, one which was missing several teeth but 
has no gingival or periodontal disease, or one who has all 
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teeth present but has significant gingival and periodontal 
disease?" Although a number of scaling procedures could 
have been used, they decided upon attempting to use the 
judgments of dental health professionals, combined with a 
modified version of the equal appearing intervals method of 
scaling, to provide relative rankings and subsequent develop- 
ment of a composite oral health index. [Ref. 284: p. 17] 

Twenty-nine dentists, representing four broad categories 
of practitioners, were selected for participation in the 
final ranking. Six of the dentists were from private 
practices, nine were from research-oriented situations, nine 
were from public health practice, and five of the dentists 
combined private practices with part-time teaching or research 
positions. [Ref. 284: p. 17] 

Forty- two profiles, each composed of four clinical condi- 
tions: (1) number of missing and unreplaced teeth (divided 

into four levels of severity) ; (2) periodontal disease 

(divided into four levels of severity) ; (3) decayed teeth 

(divided into two levels of severity) ; and (4) oral hygiene 
(divided into two levels of severity) . Each of the twenty- 
nine dentists was sent a package containing study background 
information, a set of forty- two randomly ordered computer 
punch cards (each card contained a punched and printed 
description of an oral health status profile) , and detailed 
instructions on how to rank the profiles from best to worst 



28 



using an integer scale from one to nine. The ranking by 
oral health status was accomplished by sorting the forty-two 
computer punch cards into nine piles, representing the nine 
levels of oral health indicated by the integer scale of one 
to nine. These piles were then subsequently ranked to pro- 
vide a relative ranking within each of the nine initial 
profiles. In the end, the forty-two computer punch cards, 
representing the forty- two clinical oral health profiles, 
would be ordered into a ranking such that each successive 
card or case would be in poorer oral health than the card 
or case preceding it. [Ref. 284: p. 17] The results of the 
individual dentist's rankings were then averaged and the 
means used to provide a "summary statistic" or "oral health 
index". [Ref. 284: pp . 17-18] 

In their conclusion, Nikias and her coworkers noted four 
major findings from their studies: (1) Developing a compre- 

hensive oral health index based upon professional concensus 
appears feasible. (2) Dentist's vary considerably in their 
assessment of clinical oral health states. This variation 
cannot simply be explained by professional orientations and 
activities, but seems to be subjective and varies according 
to the individual. In fact, detailed analysis of the actual 
rankings of the oral health profiles revealed that there was 
as much or more variation within each professional group as 
between groups. The greatest variability is in oral health 
states that have a combination of contrasting levels of oral 
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disease and conditions. (3) Of the four conditions that 
made up the forty- two oral health profiles, number of missing 
and unreplaced teeth and levels of periodontal disease were 
found to be most highly correlated with the final ranking and 
oral health index. (4) Based upon work accomplished to present, 
it seems difficult to devise an all-purpose oral health index. 
[Ref. 284: pp. 21-25] 

The work of Nikias and her coworkers provided an impetus 
for new directions in research and development of oral health 
indexes. These new directions, largely represented by the 
subsequent work of Marcus and his coworkers [Refs. 285-293], 
related to the use of specific statistical methodologies, 
principally the preference pairs methodology of Mickey and 
Britt [Ref. 295], to derive oral health status indexes 
reflective of opinions and preferences of expert dental 
health professionals. It is this work which is examined 
in the following chapter. 
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III. ORAL HEALTH STATUS INDEX 



A major shift in the search for a comprehensive oral 
health status index occurred during the late 1970's. After 
conducting an exhaustive search for a comprehensive oral 
health index which would satisfy the requirements of clini- 
cians, researchers, decision makers, and other interested 
parties alike, Marcus and his coworkers felt that no such 
measure currently existed. Consequently, they embarked on a 
research program of several years duration in an attempt to 
develop such a comprehensive measure. [Refs. 285-293] 

The stated aims of this research were threefold. 

First, to develop comprehensive, integrated oral health 
status measures for both adult and pediatric populations, 
primarily for monitoring both groups to evaluate the outcome 
of oral health care services. [Ref. 285: p. 3] 

Second, to develop measures of oral health status 
characterizing populations rather than individuals; 
empirically derive significant factors in the cbncept of 
oral health based upon opinions of experts (dentists) ; 
incorporate both positive factors associated with oral 
health and negative factors associated with oral pathology; 
establish quantifiable measures of oral health which permit 
statistical analysis of populations; ensure that any index 
developed is sensitive to changes in oral health status; 
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and ensure that any index developed will hold practical 
relevance for a wide range of potential users of the index, 
particularly dental practitioners, health care administrators, 
and the public. [Ref. 285: p. 3] 

Third, to utilize a methodology which will ensure the 
reliability and validity of the measures used to develop the 
index. [Ref. 285: pp . 3-4] 

Marcus and his coworkers developed a set of 232 clinical 
cases for use in their research. Each case consisted of a 
brief patient description, including a brief medical and 
dental history; color slides of facial profiles and intraoral 
appearances; a set of radiographs, including periapicals , 
bitewings, and a panorex; a set of complete plaster mouth 
study casts; and a completed dental chart. [Ref. 287: p. 335] 

A panel of twelve general dentists was selected to provide 
the expert opinions needed during the experimentation and 
development phase of the research program. The consultants 
for the panel were selected upon the following four criteria: 
(1) a minimum of five years of clinical experience; (2) past 
or current experience in quality assessment and quality 
assurance activities; (3) representation from various 
geographic and demographic regions of the United States; 
and (4) clinical practice experience limited to general 
dentistry only. [Ref. 285: p. 30] 

The methodology selected for the statistical "scaling" 
was the paired preference procedure described by Mickey and 
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Britt [Ref. 295] and available in the BMDP statistical 
package. J_Refs. 296-297] 

The experiment was conducted by presenting the 232 
clinical cases, combined in 315 pairs of cases, to each 
of the twelve consultants. Each of the consultants selected 
which case of each pair of cases they considered to be in 
better oral health. Additionally, they were permitted to 
indicate significant differences in oral health, if they 
existed. The results of this experiment provided the judg- 
ments needed for the statistical computation portion of the 
paired preference methodology. [Ref. 291: p. 286] 

Marcus and his coworkers initially used twenty-four 
variables, which were later reduced to eighteen variables, 
in the paired preference program. These included variables 
for certain health factors (diabetes, cardiovascular disorders, 
and rheumatic fever) ; temporomandibular joint (TMJ) dysfunc- 
tions (sounds, dislocation, function loss, and pain); occlu- 
sion/crossbite; tipped/extruded teeth; tooth abrasion; 
fractured teeth; unerupted teeth; missing teeth; decayed 
teeth; filled teeth; restorations; endodontics, benign 
tumors (oral neoplasms such as fibromas, osteomas, tori, 
odontogenic cysts, and odontomas); replacements; calculus, 
mild periodontal disease (mild bone loss, periodontal 
pocket depth, and tooth mobility) ; moderate periodontal 
disease (moderate bone loss, periodontal pocket depth, and 
tooth mobility) ; and severe periodontal disease (marked bone 
loss, pocket depth, and tooth mobility) . [Ref. 285: p. 27] 
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To determine the most advantageous combination of 
variables and " sub variables " , Marcus and his coworkers 
performed "nearly 100" regressions on six of the oral health 
variables deemed most significant after examination of 
initial results of the BMDP paired preference program: 

(1) mild periodontal disease; (2) moderate periodontal 
disease; (3) severe periodontal disease; (4) missing teeth; 

(5) decayed teeth; and (6) tumors. [Ref. 285: p. 73] 

Based upon the results of this initial attempt at index 

construction, the eight most promising variables obtained 
from the paired preference program were regressed against 
the judges' mean scores (from the initial BMDP paired 
preference programs using eighteen variables) in eleven 
different combinations of the variables, ranging from use 
of only four variables to use of all eight. The eight 
variables used during this stage were: (1) mild periodontal 

disease; (2) moderate periodontal disease; (3) severe 
periodontal disease; (4) missing teeth; (5) decayed teeth; 

(6) tumors; (7) occlusion; and (8) replaced teeth. Upon 

examination of the results of these regressions, Marcus and 
his coworkers reached a "strong concensus" on a model using 
five of the variables: (1) moderate periodontal disease; 

(2) severe periodontal disease; (3) missing teeth; (4) 
decayed teeth; and (5) replaced teeth. [Ref. 285: p. 78] 

Marcus and his coworkers felt that the five variables 
chosen above were "not amenable to measurement on a large 
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scale", and required modification. This was particularly 
true of the periodontal disease variables, which had included 
measures of bone loss, periodontal pockets, and tooth mobility, 
and the missing teeth variable, which had included double 
counts of free ends, cuspids, and first molars. Further 
analysis revealed that adding the number of free ends to the 
total number of missing teeth (excluding third molars) and 
using only severe and pulpal decay (excluding mild decay) , 
seemed to provide a better fit (higher R-squared values) to 
the mean case scores (derived from the initial BMDP paired 
preference program using eighteen variables). Additionally, 
a decision was made to use only the periodontal pocket depth 
as the measure of periodontal disease. Thus, the final five 
variables selected for the direct adult oral health index 
included: (1) moderate periodontal disease (moderate 

periodontal pocket depth) ; (2) severe periodontal disease 

(marked periodontal pocket depth) ; (3) missing teeth and free 

ends; (4) decayed teeth (severe and pulpal decay) ; and (5) 
replaced teeth. [Ref. 285: pp. 78-79] 

The scores were subsequently scaled so that the maximum 
score (best case of oral health) would be 100 and the minimum 
score (edentulous case) would be zero. [Ref. 291: p. 288] 

The final beta coefficients (weights) for the five 
variables for the index were as follows: (1) missing teeth 

and free ends: -3.31; (2) replaced teeth: +0.61; (3) decayed 

teeth: -1.79; (4) periodontal pocket depth (4-6 mm) : -0.73; 

and (5) periodontal pocket depth (6+ mm) : -3.02. [Ref. 292: p. 1] 
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To use the oral health status index, the patient is 
examined and the results are entered on the direct oral health 
status index adult examination form in Figure 1. Each tooth 
is marked as to whether it is missing (M) , replaced (R) , 
decayed (D) , normal (N) , or a space closure (C) ; the peri- 
odontal pockets are indicated at 4-6 mm and 6+ mm. The totals 
for each of the categories (missing, replaced, decayed, 4-6 mm 
pockets, and 6+ mm pockets) are placed in the # (total number) 
blank, multiplied by the appropriate beta coefficient (weight), 
the resulting products subtracted from 100, and the result 
placed in the blank for the final index. [Ref. 292: p. 732] 

The direct oral health status index, once ascertained, 
provides a measure of the overall oral health status of the 
individual examined, and when combined with other representa- 
tives of a population of interest, provides an epidemiological 
index useful in a wide range of health care activities, par- 
ticularly administration, planning, quality assessment, and 
research . 

The oral health status index developed by Marcus and his 
coworkers, of all the oral health indexes reviewed in the 
literature, appeared to provide the greatest potential for 
an oral health index within the health care system of the 
military services. As such, it provided the focal point for 
the majority of this current thesis effort contained within 
the following chapters . 
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DIRECT ORAL HEALTH STATUS INDEX 
ADULT EXAMINATION FORM 
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Figure 1. Direct oral health status index adult 
examination form. 
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IV. ORAL HEALTH STATUS INDEX EVALUATION 



A. BACKGROUND 

After a thorough review of the literature ..vailable on 
oral health indexes (see bibliography) , the adult direct oral 
health status index developed by Marcus and his coworkers 
[Refs. 285-294] seemed to possess the greatest potential for 
the military health care system as an oral health status 
index. A number of questions concerning both its development 
and use were raised, however, and provided the impetus for 
this thesis . 

There were two rimary objectives for this thesis: Firs - ., 

to verify the validity of the oral health status index through 
examination of its development and construction. And second, 
to subsequently utilize methodologies and procedures similar 
to those used by Marcus and his coworkers, particularly those 
employed by Koch in her doctoral dissertation [Ref. 289] , and 
apply them to military dentists and health care beneficiaries 
to verify the oral health status index's validity for the 
population served by the health benefit programs of the 
uniformed services, in particular the Navy. 

As will be noted .s the thesis progresses, significant 
problems were encountered during evaluation of the or:;, health 
status index. These problems made accomplishing the second 
thesis objective impractical. Consequently, the remainder 
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of this thesis is largely devoted to verifying the validity 
of the index's development and construction. 

B. THE FIRST STEPS 

The researchers were able to spend several days at the 
University of California at Los Angeles (UCLA) dental school 
with Dr. Marvin Marcus, the driving force behind the oral 
health status index. During this time, Dr. Marcus provided 
a great deal of personal insight into the development, 
construction, and use of the oral health status index, as 
well as a wealth of information and data from his and his 
coworkers ' initial work on the index. 

Dr. Marcus provided copies of all publications and 
articles produced during, and subsequent to, development of 
the oral health status index. More important, however, he 
provided computer printouts containing the initial, un- 
transformed data (not otherwise available) derived from the 
original 237 (only 232 were actually used by Dr. Marcus and 
his coworkers) clinical dental cases used in development of 
the oral health status index. 

Perhaps even more important. Dr. Marcus provided quintes- 
sential insight into the processes involved in development of 
the oral health status index, his own concerns about using the 
index as planned by these researchers, and his own ideas for 
future directions and research for oral health status indexes. 

Based upon the available data and literature, as well as 
Dr. Marcus's insightful guidance, an initial plan was developed 
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to accomplish the two principal objectives of this thesis 
research, noted above. 

Due to time and logistical constraints, a decision was 
made to use only 66 of the initial 237 clinical cases in 
subsequent research within the naval health care community. 
These cases had been used in follow-on research by Marcus 
and Schoen in ascertaining the relationship between oral 
health status and dentists' preferences for treatment 
palnning [Ref. 298], and were considered representative of 
the initial 232 clinical cases used in development of the 
oral health status index. Using the 66 selected clinical 
cases and the original, untransformed data used in development 
of the oral health status index, the results of further re- 
search within the naval health care environment could be 
compared, and the validity across populations evaluated. 

The 66 clinical cases provided by Dr. Marcus (see 
Appendix A) included a brief patient description, including 
medical and dental histories; color slides of facial profiles 
and intraoral appearances; a set of radiographs, including 
periapicals, bitewings, and a panorex; a set of complete 
plaster mouth study casts; and a completed dental chart. 

The variables of interest for all 66 clinical cases had 
been previously extracted by Dr. Marcus and his coworkers 
and were embedded within the computer printouts containing 
the original, untransformed data. This data was extracted 
from the computer printouts and written onto case abstraction 
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forms, Figure 2, for each of the 66 cases. This data, 
with the following exception, was then entered into a working 
computer file for further analysis. The variables for the 
demographic and health variables were converted from the 
system used by Dr. Marcus and his co-workers to systems of 
"dummy" variables. Thus in the case of the race variable, 
rather than entering a 1 if American Indian, a 2 if Black, a 
3 if Oriental, etc., dummy variables (1 or 0) were used to 
indicate that an individual belongs (1) to that specific 
racial category, or does not (0) . Because the data within 
these variables were primarily qualitative rather than quanti- 
tative in nature, this methodology was considered more useful 
statistically. [Ref. 299: p. Ill] 

The initial data set for each of the 66 cases (see 
Appendix B) , derived from the original, untransformed data 
provided by Dr. Marcus, yielded 208 variables, as indicated 
in Figure 3. As can be seen, these included age; sex; race; 
history of diabetes, cardiovascular disease, or rheumatic 
fever; temporomandibular joint disease as manifest by sounds, 
dislocation, loss of function, or pain; occlusion, class I, 

II, or III; crossbite, anterior or posterior; gingivitis, 
acute or chronic; severely extruded teeth; severely abrated 
teeth; fractured teeth, mild, severe, or periapical; unerupted 
teeth; missing teeth, total, cuspids, first molars, free ends, 
or third molars; tipped teeth; virgin decay, mild, severe, or 
pulpal ; recurrent decay, mild, severe, or pulpal; filled teeth. 
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Source: Marc , Marvin; Gershen, Jay A.; ana Koch, Alma L. 

Development of Oral Health Status Measures for Quality 
Assurance. Final Report . Chicago: American Fund for Dental 

Health and the W .K . Kellogg Foundation, May 19 80, p. 20. 



Figure 2. Clinical case abstraction form. 
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Original 203 clinical variables 



serviceable or defective; restorations, serviceable or 
defective; tumors; replaced teeth, fixed pontics or removable; 
calculus; bone loss, mild, moderate, or severe; periodontal 
pockets, 0—1.9 mm, 2-3.9 mm, 4-5.9 mm, or 6+ mm; and mobility, 
class I, II, or III. Additionally the latter of these, from 
extruded teeth through mobility, are also characterized by 
position of occurrence within the mouth, maxillary (upper) 
or mandibular (lower) and anterior (front' r posterior (back) , 
as well as totals. 

It is these 66 uses, with their 208 variables, that pro- 
vide the starting point for further analysis and investigation, 
primarily through the BMDP preference pairs program. 

[Refs. 296-297] 



C. THE PAIRED PREFERENCE PROGRAM 

The paired preference program, developed by Mickey and 
Britt in the early 1970 's [Ref. 295), provides a methodology 
for deriving numerical scores for each of the clinical cases, 
based upon the judgments (preferences) of expo , in this 
case, dentists. This methodology is available through the 
3MDP statistical software packages developed by the University 
of California. [Refs. 300-301] 

The BMDP preference pairs program constructs a numerical 
score for each case that is a linear combination of the 
variables used in the analysis: 

Case Score = • 1 X ± + 2 :: 2 + 3 + • • • - ~ n ;; n' 
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where the Beta-coefficients are derived from the judgments 
(preferences) of experts, in this case dentists. [Ref. 296: 
p. 547] 

The dentists compare two clinical cases at a time, 
evaluating whatever data and information is of value in that 
professional's particular methodology of clinical assessment, 
and selects the case felt to be in better oral health. 

The input to the BMDP preference pairs program consists 
of a preference matrix and a data matrix. The preference 
matrix is composed of the paired cases and the preferences 
of the dentists (see Appendix L) . The preference of each of 
the dentists is indicated as follows: If the first case of 

the pair is preferred over the second, the preference is 
noted as a "1", if the second case of the pair is preferred 
over the first, the preference is noted as a "-1" . When no 
preference is indicated, a zero is recorded (an option Marcus 
and his coworkers did not permit) [Ref. 285: p. 13] . The 
strength of the preference may also be indicated. For 
example, if the first case is preferred twice as much as the 
second, a "2" would be recorded; if the second case is pre- 
ferred three times as much as the first, a "3" would be 
recorded. The data matrix is composed of the variables in 
the data base of each case. [Ref. 296: p. 547] 

For each pair of cases, Y. = (X.,, X.„, X. . .., X. ) 
c l il i2 i3 in 

and Y. = (X.., X . ~ , X. 0/ ..., X.), a judgement vector (the 

3 3 1 ' 32 ' 33 in' J 

dentist's preference), Z = (X.. - X.., X._ - X._, X._ - X.- , 

1 _L ^ X X Z J ^ X-j 3-^ 

..., X^ n - Xj n ) is computed. A cross-product matrix is 
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subsequently formed, stepwise multiple regression is 
accomplished, an algorithm (model) is developed for each 
dentist, and scores are calculated for each clinical case. 
[Ref. 296: p. 548] 

The Beta-coefficients determined for each of the varia- 
bles (Xs) provides the weights (clinical importance) of the 
dentist's judgments (clinical assessments of oral health) 
for those variables within the data base. [Ref. 296: p. 547] 

D. A FIRST LOOK 

The original, untransformed data base (see Appendix B) , 
containing 66 clinical cases with their respective 208 
variables, was processed through the BMDP preference pairs 
program [Ref. 296: pp . 547-553]. The results of this analysis 
are provided in Appendix C. As can be seen from the data, the 
preference pairs program develops a separate model (algorithm) 
for each dentist. Additionally, the program was formatted so 
that a model was developed for the "average" dentist for 
subsequent use in constructing an oral health status index. 

The data in Table 1 is abstracted from Appendix C and 
provides the final step from the stepwise multiple regression 
portion of the BMDP preference pairs program for each of the 
twelve dentists and the "average" dentist. As can be noted, 
no two dentists have exactly the same model. 

The number of variables ranges from 21, for the second 
dentist, to 23 for the "average" dentist, with 22 variables 
for all others. The variables involved differ from dentist's 
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RESULTS OF FINAL STEP OF THE MULTIPLE REGRESSION PHASE 
OF THE PREFERENCE PAIRS PROGRAM FOR EACH INDIVIDUAL 
DENTIST AND THE "AVERAGE" DENTIST USING 66 CLINICAL CASES 
AND 208 VARIABLES. 
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MULT R R^ MULT R R MULT R R MULT R R 

0.99666 0.993 0.98802 0.976 0.99717 0.994 0.99685 0.994 



RESULTS OF FINAL STEP OF THE MULTIPLE REGRESSION 
PHASE OF THE PREFERENCE PAIRS PROGRAM FOR EACH 
INDIVIDUAL DENTIST AND THE "AVERAGE" DENTIST USING 
66 CLINICAL CASES AND 208 VARIABLES. 
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RESULTS OF FINAL STEP OF THE MULTIPLE REGRESSION 
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75235 0.566 



model to dentist’s model. Additionally, even when the same 
variables are involved, the Beta-coefficients (weights) and 
t-values differ significantly between individual dentists. 

As can be seen in Table 1, the R-squared values, showing 
the "goodness of fit" of the individual models, range from 

0. 566 for the "average" dentist, to 1.000 for the third 
dentist. Based on the work of Nikias et al., this finding 
was not at all unexpected. In their work on developing an 
oral health status index based upon ranking of oral status 
profiles by panels of dental professionals, Nikias et al . 
found that dentists tended to develop very individual models 
of clinical assessment. The greatest variability in clinical 
assessment occurred between dentists when clinical cases 
contained a combination of contrasting levels of oral disease 
and conditions which brought them close to the same level of 
overall oral health. [Ref. 308: pp . 21-25] Thus in a situation 
where the clinical cases are intentionally paired so that 70% 
of them are very close in overall oral health, as they are in 
this situation [Ref. 285: p. 25], one would expect the R-squares 
for the individual dentists' models to be higher than that for 
the "average" dentist's model. 

Of principal importance is the "average" dentist's model, 
since this model provides the foundation for any oral health 
status index subsequently developed. As can be seen in Table 

1, the greatest t-values (B/SEB) are associated with the 

following variables: total severely fractured teeth (1.183) ; 
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total lower posterior missing teeth (0.541); upper 
posterior tipped teeth (0.420); lower anterior teeth with 
virgin decay (0.402); being female (0.105); and lower 
anterior replaced fixed pontics (0.101) . Not only does the 
size of the model (the number of variables involved) make it 
impractical for use as an oral health index, the directions 
of some of the Beta-coefficients (weights) are intuitively 
bothersome in this model. For example, total severely frac- 
tured teeth is positively related to oral health (0.62540), as 
is upper posterior tipped teeth (0.01511) . More will be said 
about this phenomenon later. 

Table 2 provides a correlation matrix revealing correlations 
between clinical case scores as computed through each indi- 
vidual dentist's model. As can be seen, the correlations 
range from -0.0598 (between dentists nine and eleven) to 0.6789 
(between dentists eight and twelve) . 

The work of Nikias et al . had indicated that high correla- 
tions under these circumstances should not be expected. [Ref. 
308: pp . 21-25] Marcus et al. in their work in developing an 
oral health status index, however, had reported very high 
correlations between judges' scores, ranging from 0.8156 to 
0.9623. [Ref. 285: pp . 41-42] 

Examination of dentists' preferences within specific case 
pairings, however, showed a wide range (see Appendix L) . For 
example, for pairings of clinical cases four and six, the 
twelve dentists' preferences ranged from -2 to 2 (2, -1, 1, -2, 
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CORRELATION MATRIX REVEALING THE CORRELATIONS 
BETWEEN CASE SCORES AS COMPUTED FROM INDIVIDUAL 
MODELS OF THE TWELVE DENTISTS USING 66 CLINICAL 
CASES AND 208 VARIABLES. 
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-2, 1, 1, 2, 1, 2, 1, and 2), as was true for clinical 
cases 43 and seven (1, -1, -1, -2, 1, 2, -1, 1, 1, 2, 2, and 
1) , thirty and 36 (1, -1, -1, 2, - 2 , 1, 2, 1, 2, - 2 , - 2 , and 
-1) , and forty and five (1, -1, -1, 2, 1, 1, -1, 2, 1, -2, -1, 
and 1) . It should be noted that these represent the maximum 
range (-2 to 2) allowed by Marcus et al. when pairings of 
clinical cases were presented to the dentist consultants. 

[Ref. 285: p. 23] 

In fact, only 30.4 percent of the pairings of the 66 
clinical cases revealed the same direction for all twelve 
dentist's preferences (all preferred the first case (+) or 
all preferred the second case (-) of any pairing) . And none 
of these pairings revealed the same degree of preference (all 
ones or all twos) for any one case over its alternative 
selection. 

E. CLUSTERING INTO FACTORS 

The original, untransformed data base (see Appendix B) , 
containing 66 clinical cases, with their respective 208 
variables, was processed through the BMDP factor analysis 
program [Ref. 302: pp . 480-499] in an attempt to reduce the 
number of variables under consideration through clustering 
the initial variables into "factors", composed of several 
variables, which seemed to provide the greatest explanatory 
power for the dentists' preferences. 

Forty-nine factors , largely corresponding to the totals 
of each of the major variables (a sum of the positional 
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variables) initially seemed to have the greatest explanatory 
power for the dentists' preferences. Six of these factors, 
however, were subsequently dropped. These factors related 
to bone loss (mild, moderate, and severe) and tooth mobility 
(class I, II, and III) variables) . Bone loss is highly 
correlated with, and essentially measures the same clinical 
phenomenon as, periodontal pocket depth. [Refs. 30 3- 306 ] Thus 
bone loss, as determined from radiographic measurements using 
the Schei scale [Ref. 303] , was eliminated and periodontal 
pocket depth, as measured by use of a periodontal probe, was 
retained. Tooth mobility, like bone loss, is also highly 
correlated with periodontal pocket depth. Additionally, 
however, there are measurement problems with tooth mobility 
that make measurement of periodontal pocket depth more advan- 
tageous in assessing oral health status. [Ref. 307] Tooth 
mobility was thus eliminated in favor of periodontal pocket 
depth measurement. It should be noted that all three of these 
factors (bone loss, periodontal pocket depth, and tooth 
mobility) were included within the variables labeled periodon- 
tal disease (mild, moderate, and severe) in Marcus and his 
coworkers initial work. [Ref. 285: p. 27] They too, however, 
elected to eventually eliminate bone loss and tooth mobility 
from their final direct oral health index, retaining periodontal 
pocket depth as a measure of periodontal disease. [Ref. 285: 
pp . 78-79] 

A new, transformed data base was created (see Appendix D) 
containing 66 clinical cases with their new 43 factors 
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TABLE 3 



FORTY-THREE TRANSFORMED 
VARIABLES FROM SIXTY-SIX 
CLINICAL CASES. 



VARIABLE VARIABLE NAME 



XI* 

X2 

X3 

X4 

X5 

X6 

X7 

X8 

X9 

X10 

Xll 

X12 

XI 3 

X14 

XI 5 

X16 

X17 

X18 

XI 9 

X20 

X21 

X22 

X23 

X24 

X25 

X2 6 

X27 

X28 

X29 

X30 

X31 

X32 

X33 

X34 

X35 

X36 

X37 

X38 

X39 

X40 

X41 

X42 

X43 



Case Mo. 

TMJ Sounds 
TMJ Dislocation 
TMJ Function Loss 
TMJ Pain 

Occlusion, Class I 
Occlusion, Class II 
Occlusion, Class III 
Crossbite, Anterior 
Crossbite, Posterior 
Gingivitis, Acute 
Gingivitis, Chronic 
Extruded, Severe, Total 
Abrasion, Severe, Total 
Fracture, Mild, Total 
Fracture, Severe, Total 
Fracture, Periapical, Total 
Unerupted Teeth, Total 
Missing Teeth, Total** 

Missing Teeth, Cuspid/lst Molar, Total 
Missing Teeth, Free Ends, Total 
Missing Teeth, 3rd Molar, Total 
Tipped Teeth, Total 
Virgin Decay, Mild, Total 
Virgin Decay, Severe, Total 
Virgin Decay, Pupal, Total 
Recurrent Decay, Mild, Total 
Recurrent Decay, Severe, Total 
Recurrent Decay, Pupal, Total 
Fillings, Serviceaole, Total 
Fillings, Defective, Total 
Restorations, Serviceable, Total 
Restorations, Defective, Total 
Endodontics, Serviceable, Total 
Endodontics, Defective, Total 
Tumors, Total 

Replaced Teeth, Fixed Pontics, Total 
Replaced Teeth, Removable, Total 
Calculus, Total 

Periodontal Pockets, 0-1. 9mm, Total 
Periodontal Pockets, 2-3. 9mm, Total 
Periodontal Pockets, 4-5. 9mm, Total 
Periodontal Pockets, 6+mm, Total 



‘Case Label only, not involved in regression. 

**Total does not include wisdom teeth. 
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RESULTS OF FINAL STEP OF THE MULTIPLE REGRESSION 
PHASE OF THE PREFERENCE PAIRS PROGRAM FOR EACH 
INDIVIDUAL DENTIST AND THE "AVERAGE" DENTIST USING 
66 CLINICAL CASES AND 43 VARIABLES. 
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MULT R R 

0.75236 0.566 



(variables) (see Table 3) . As can be seen in Table 3, the 
new 43 factors include variables for temporomandibular joint 
disease (sounds, dislocation, loss of function, and pain); 
occlusion (class I, II, and III) ; crossbite (anterior and 
posterior) ; gingivitis (acute and chronic) ; extruded teeth 
(severe) ; abrated teeth (severe) ; fractured teeth (mild, 
severe, and periapical) ; unerupted teeth; missing teeth 
(total, cuspids, first molars, free ends, and third molars) ; 
tipped teeth; virgin decay (mild, severe, and pulpal) ; 
recurrent decay (mild, severe, and pulpal) ; fillings (service- 
able and defective) ; restorations (serviceable and defective) ; 
endodontics (serviceable and defective); tumors; replaced 
teeth (fixed pontics and removable) ; calculus; and periodontal 
pockets (0-1.9 mm, 2-3.9 mm, 4-5.9 mm, and 6+ mm) . 

This new, transformed data base (see Appendix D) , contain- 
ing 66 clinical cases with their respective 43 variables, was 
processed through the BMDP preference pairs program [Ref. 296: 
pp . 547-553]. The results of this analysis are provided in 
Appendix E. As can be seen from the data, the preference 
pairs program again developed a separate model for each 
dentist as well as a model based upon the "average" dentist. 

The data in Table 4 is abstracted from Appendix E and 
provides the final step from the stepwise multiple regression 
portion of the BMDP preference pairs program for each of the 
twelve dentists and the "average" dentist. Again, as with 
the earlier BMDP preference pairs program output with 208 



61 



variables, no two dentists have exactly the same model. There 
are 22 variables for each of the dentists' models and 23 varia- 
bles for the "average" dentist's model. As noted in the 
earlier model, the variables involved differ from dentist's 
model to dentist's model. Additionally, as seen before with 
208 variables, even when the variables are the same, the Beta- 
coefficients (weights) and t-values for each of the dentists 
differ significantly. 

As can be seen in Table 4, the R-squared values of the 
individual models range from 0.566 for the "average" dentist 
to 1.000 for the third dentist. The earlier discussion con- 
cerning R-squared values applies here as well. 

As before, the model developed for the "average" dentist 
is of pivotal importance in any subsequent development of an 
oral health status index. As can be seen in Table 4, the 
greatest t-values (B/SEB) are associated with the following 
variables: total severely extruded teeth (1.185); total 

teeth with recurrent pulpal decay (0.735); temporomandibular 
joint pain (0.706); chronic gingivitis (0.663); total missing 
teeth, free ends (0.619) ; and total replaced teeth, fixed 
pontics (0.548) . As in the earlier BMDP preference pairs 
program output using 208 variables, however, the size of the 
model (number of variables) make it impractical for use as an 
oral health index and the directions of some of the Beta- 
coefficients (weights) in this model are again intuitively 
bothersome. For example, total severely extruded teeth is 
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positively related to oral health (0.22906), as is temporo- 
mandibular joint pain (0.41258) . More will be said concerning 
this phenomenon later . 

Table 5 provides a correlation matrix revealing correla- 
tions between clinical case scores computed through each 
individual dentist's model. As can be seen, the correlations 
range from -0.2159 (between dentists three and twelve) to 
0.6030 (between dentists one and three). The earlier discus- 
sion concerning correlations between clinical case scores, in 
the BMDP preference pairs program using 208 variables, applies 
here as well. 

F . PARING DOWN 

The transformed data base (see Appendix D) , containing 
66 clinical cases, with their respective 43 variables, was 
processed through the BMDP factor analysis program [Ref. 302: 
pp. 480-499] in a further attempt to reduce the number of 
variables under consideration, through further clustering of 
the previously transformed variables. 

Fourteen factors appeared to account for the majority of 
the explanatory power of these 43 variables, and are shown in 
Table 6. As can be seen, these variables include gingivitis 
(acute and chronic) ; extruded teeth (severe) ; fractured 
teeth; missing teeth (total and free ends) , decayed teeth 
(virgin and recurrent); fillings and restorations; endodontics 
replaced teeth; and periodontal pocket depth (0-3.9 mm, 4-5.9 
mm and 6+ mm) . 
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CORRELATION MATRIX REVEALING THE CORRELATIONS 
BETWEEN CASE SCORES AS COMPUTED FROM INDIVIDUAL 
MODELS OF THE TWELVE DENTISTS USING 66 CLINICAL 
CASES AND 43 VARIABLES. 
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TABLE 6 



FOURTEEN CLINICAL VARIABLES 



Vari able 



Variable Name 



XI* 

X2 

X3 

X4 

X5 

X6 

X7 

X8 

X9 

X10 

Xll 

X12 

X13 

X14 



Case Number 
Gingivitis, Acute 
Gingivitis, Chronic 
Extruded Teeth, Severe Total 
Fractured Teeth, Total 
Missing Teeth, Total** 

Missing Teeth, Free Ends, Total 
Decayed Teeth, Total 
Filled and Restored Teeth, Total 
Endodontics, Total 
Replaced Teeth, Total 
Periodontal Pockets, 0-3.9 mm 
Periodontal Pockets, 4-5.9 mm 
Periodontal Pockets, 6+ mm 



*Case label only, not involved in regression. 

**Total does not include wisdom teeth. 



This newly transformed data set (see Appendix F) , con- 
taining 66 clinical cases with their respective 14 variables, 
was processed through the BMDP preference pairs program [Ref: 
296: 547-553]. The results of this analysis are provided in 
Appendix G. As can be seen from the data, the preference 
pairs program again developed a separate model for each 
dentist as well as a model based upon the "average" dentist. 

The data in Table 7 is abstracted from Appendix G and 
provides the final step from the stepwise multiple regression 
portion of the BMDP preference pairs program for each of the 
twelve dentists as well as the "average" dentist. Again, as 
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RESULTS OF FINAL STEP OF THE MULTIPLE REGRESSION 
PHASE OF THE PREFERENCE PAIRS PROGRAM FOR EACH 
INDIVIDUAL DENTIST AND THE "AVERAGE" DENTIST USING 
66 CLINICAL CASES AND 14 VARIABLES. 



3 

< 

> 



cMinor*Ovor^coor^ooin 



ocmOo^o.— ioooor-*o 



CM 

X 



o 

m 

33 

O 



X 

3 3 
CQ X 
3 s 3 
0 3 0 
3 2 0 
3 

n x 
3 
£-* 

3 

IX 

< 

> 



o <— ir-oin^rcMONcoininaoin 

!jiM-OrHinioa\nr'riinin^ 

r'f s iofl'Oci^riHi/iiO( , ir s 

ainnr-HHiTHo^^oofN 



OoOOOOOOOOOOO 
II I I I I III 



O H (N m TT 



o 

X 33 

E-I CM 

3 O'* 
3 * 

2 ^ 



r^r‘in^rr*HHOa3<Tiin'«T^r 

^rcM^rOinor^oo^ocno 

<yiM3inmr-cMinocM^r-<TM3H 

lOOOOOCMOCMOOOO 



X 
m M 
3 
3 Z 
O 3 
Q 2 
3 

n 3 

3 

E- 

3 



nnincoiniOH^nHHHM' 

ooor"*cor*<Ti^H<yi^aoocM 

JnrCW*1(NOOHHOHH 

r^ooocMCMa30®coin<yico 

aovooooooo*r<NOOO 

OOOOOOOOOOOOO 



5S 

io 



X 

< 

> 



ocoinH*rt-‘in<7'coaocMO 

<yif s *cor*cNcocMoco^H^r^ro 

|M3in'TOa3®coorrcMOOin 



6-4 oooooooooo* 



X 

Cl U lb 
3 3 
3 Z 3 
0 3 0 

a 2 u 

3 

n x 

3 

E-* 

3 

X 

< 

> 



coocMcocoa>corr*raoin< 
^aMT>M , (N<?coinM , HO( 
M-a3 0MOHiOHomaoo< 
TraorrcM^rO'rOOinint 
^HCO^-tOCMr-OO'-'OCMl 

O0000000000 



0 o 

1 I 



X ^ 
6* CO 



3 * 

2 o 



CMcoTTinor^aotri^o. 



33<3><— <<— 4r'M30r~<r^r' 
iOijiHci4Taoioo>HM’onr' 
^{NCI^HinOCOO^CO^^ 



I O CM CM O t 



I CM CM CM CM CM 



X 

hUCl 
3 3 
3 Z 3 
0 3 0 

a 2 o 

3 

n x 

3 

E-» 



3 



■'TTa\HHO^H^Offly3 

c-HHco^^ino'J'OiOHO 
OrMinCMr--— tOiTlOmrOCOO 
lOHMHOCOHO^ 4fOOlO 

OOOOOOOOOOOOO 



CMco«<Tinor-aoaw 



CM 

X r- 

o 

! O 

3 ^ 
3 • 

2 a 



66 



RESULTS OF FINAL STEP OF THE MULTIPLE REGRESSION 
PHASE OF THE PREFERENCE PAIRS PROGRAM FOR EACH 
INDIVIDUAL DENTIST AND THE "AVERAGE” DENTIST USING 
66 CLINICAL CASES AND 14 VARIABLES. 
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RESULTS OF FINAL STEP OF THE MULTIPLE REGRESSION 
PHASE OF THE PREFERENCE PAIRS PROGRAM FOR EACH 
INDIVIDUAL DENTIST AND THE "AVERAGE" DENTIST USING 
66 CLINICAL CASES AND 14 VARIABLES. 
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RESULTS OF FINAL STEP OF THE MULTIPLE REGRESSION 
PHASE OF THE PREFERENCE PAIRS PROGRAM FOR EACH 
INDIVIDUAL DENTIST AND THE "AVERAGE" DENTIST USING 
66 CLINICAL CASES AND 14 VARIABLES. 



AGE 

13 

T-VAL 


nr-fNO'OininMJiHooino 

mo-^raocNOHODrj'cNmr'VO 

m ^(NHnojnao oinojh 


«r 

<T\ 

CM rr 

a • 
o 




05 05 


ajrna(No^u>orr(anM^ 


m 




It] Cd Ct4 


(NcD^r'^a , \<j'ODOvooHco 


05 ^ 




> CQ Cl* 


r-oocN^r»<T'0^r^(vj'i3fN» 


m 




< 2 M 
2 O 


coo>conHoooD^^H(Nin(N 






JUDGE 
STEP N 
VAR C 


r-HOOOOOOOOOOOO 
1 III III 

(Nn^invOMXJWHHHHH 


ID • 
2 O 





69 



with the earlier BMDP preference pairs programs with 208 and 
43 variables, no two dentists have exactly the same model. 
Although the same variables are involved in each individual 
dentist's model, the Beta-coefficients (weights) and t-values 
of the variables within each of the dentist's models differ 
significantly . 

As can be seen in Table 7, the R-squared values of the 
individual models range from 0.399 for the second dentist, to 
0.850 for the fourth dentist. Unlike the earlier BMDP pref- 
erence pairs programs, for 208 and 43 variables, however, the 
model developed for the "average" dentist does not possess the 
lowest R-squared value, but is an intermediate value, 0.494. 

As with models seen previously, the model developed for 
the "average" dentist is of pivotal importance in any sub- 
sequent development of an oral health status index. As can 
be seen in Table 7, the greatest t-values (B/SEB) are associa- 
ted with the following variables: chronic gingivitis (4.047) ; 
acute gingivitis (3.323) ; total missing teeth (3.286) ; total 
decayed teeth, virgin and recurrent (3.175); total periodontal 
pockets, 4-5.9 mm (2.745) ; total severely extruded teeth 
(2.452) ; total periodontal pockets, 0-3.9 mm (2.328) ; and 
total free ends (2.095) . As with earlier BMDP preference 
pairs program outputs with 208 and 43 variables, however, the 
directions of some of the Beta-coefficients (weights) in this 
model are intuitively bothersome. For example, acute gingivitis 
is positively related to oral health (1.18728), as are severely 
extruded teeth (0.18096) and total fractured teeth (0.13272) . 
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Table 8 provides a correlation matrix revealing correla- 
tions between clinical case scores computed through each 
individual dentist's model. As can be seen, the correlations 
range from -0.2159 (between dentists three and twelve) to 
0.603 (between dentists one and three) . The earlier discus- 
sion, concerning correlations between clinical case scores 
in the BMDP preference pairs program using 208 and 43 variables, 
applies here as well. 

G. A WORKABLE MODEL? 

The newly transformed data base (see Appendix F) , con- 
taining 66 clinical cases with their respective fourteen 
variables, was processed once again through the BMDP factor 
analysis program [Ref. 302: pp . 480-499], in a further 

attempt to reduce the number of variables under consideration, 
through additional clustering of the newly transformed 
variables . 

Seven factors appeared to account for the vast majority 
of the explanatory power of the fourteen variables, and are 
shown in Table 9. As can be seen,' these variables included 
decayed teeth (including fractured teeth, virgin decay, 
recurrent decay, defective fillings, defective restorations, 
and defective endodontics); replaced teeth (fixed pontics 
and removable) ; and periodontal pocket depths (2-3.9 mm, 

4-5 .9 mm, and 6+ mm) . 

The newly transformed data base (see Appendix H) , con- 
taining 66 clinical cases, with their respective seven variables, 
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CORRELATION MATRIX REVEALING THE CORRELATIONS 
BETWEEN CASE SCORES AS COMPUTED FROM INDIVIDUAL 
MODELS OF THE TWELVE DENTISTS USING 66 CLINICAL 
CASES AND 14 VARIABLES . 
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TABLE 9 



SEVEN CLINICAL VARIABLES 



Variable 


Variable Name 


XI* 

X2 

X3 ' 

X4 

X5 

X6 

X 7 


Case Number 

Missing Teeth, Total ar 
Decayed Teeth, Total 
Replaced Teeth 
Periodontal Pockets, 
Periodontal Pockets, 
Periodontal Pockets, 



*Case label only, not involved ir 
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was processed through the BMDP preference pairs program 
[Ref. 296: pp . 547-553], The results of this analysis are 
provided in Appendix I . As can be seen from the data, the 
preference pairs program again developed a separate model 
for each dentist as well as a model based upon the "average" 
dentist . 

The data in Table 10 is abstracted from Appendix I and 
provides the final step from the stepwise multiple regression 
portions of the BMDP preference pairs program for each of the 
twelve dentists and the "average" dentist. Again, as with 
earlier BMDP preference pairs programs using 208, 43, and 14 
variables, no two dentists have exactly the same model. 

Although the same variables are involved within each individual 
dentist's model, the Beta-coefficients (weights) and t-values 
differ signf iciant ly . 

As can be seen in Table 10, the R-squared values of the 
individual dentists' models range from 0.339 for the fifth 
dentist, to 0.736 for the sixth dentist. The R-squared value 
of the "average" dentist's model is 0.427, and as in the last 
model, using fourteen variables, is not the lowest of the 
R-squared values. 

As in the models developed previously, using 208, 43, and 
14 variables, the model developed for the "average" dentist 
is of pivotal importance in subsequent development of an oral 
health status index. As can be seen in Table 10, the t-values, 
in descending order, for the seven variables were: total 
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RESULTS OF FINAL STEP OF THE MULTIPLE REGRESSION 
PHASE OF THE PREFERENCE PAIRS PROGRAM FOR EACH 
INDIVIDUAL DENTIST AND THE "AVERAGE" DENTIST USING 
66 CLINICAL CASES AND SEVEN VARIABLES. 
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RESULTS OF FINAL STEP OF THE MULTIPLE REGRESSION 
PHASE OF THE PREFERENCE PAIRS PROGRAM FOR EACH 
INDIVIDUAL DENTIST AND THE "AVERAGE" DENTIST USING 
66 CLINICAL CASES AND SEVEN VARIABLES. 
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ABLE 10 (CONT'D) 
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missing teeth and free ends (7.000); total periodontal pocket 
depth, 6+ mm (5.948); total periodontal pocket depth, 4-5.9 
mm (4.775); total periodontal pocket depth 6+ mm (4.118); total 
replaced teeth (2.850); and total decayed teeth (1.032). 

Unlike earlier models developed by the BMDP preference pairs 
program with 208, 43, and 14 variables, all Beta-coefficients 
of the seven variables appear to be in appropriate directions. 
For example, total missing teeth and free ends are negatively 
related to oral health (-0.328) , as are total decayed teeth 
(-0.01522), and total periodontal pocket depths, 2-3.9 mm 
(-0.19654), 4-5.9 mm (-0.23257), and 6+ mm (-0.34511); while 
total replaced teeth is positively related to oral health 
(0.13413) . 

Table 11 provides a correlation matrix revealing correla- 
tions between clinical case scores computed through each 
individual dentist's model. As can be seen, the correlations 
range from 0.4838 (between dentists five and ten) to 0.9872 
(between dentists one and twelve) . As can also be seen, these 
correlations differ significantly from those seen earlier with 
208, 43, and 14 variables. 

H. FROM MODEL TO INDEX 

The last BMDP preference pairs program model developed 
above, using seven variables, appeared to provide a reasonable 
basis for development of an index of oral health status. 

First, it was composed of a practical number of variables, 
seven. Second, it appeared clinically valid. That is, it 
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combined elements common to most of the oral health indexes 
developed in the past: decayed teeth, missing teeth, re- 

placed teeth, and periodontal pocket depths. Additionally, 
where there are differing levels of clinical severity, both 
the Beta-coefficients (weights) and t-values (statistical 
significance) show appropriate movement. For example, 
periodontal pocket depths of 2-3.9 mm have Beta-coefficients 
of -0.19654 and t-values of 4.118; periodontal pocket depths 
of 4-5.9 mm have Beta-coefficients of -0.23257 and t-values 
of 4.775; and periodontal pocket depths of 6+ mm have Beta- 
coefficients of -0.334511 and t-values of 5.948. Thus the 
model indicates not only increasing clinical weights associa- 
ted with increases in clinical severity, but reveals increasing 
statistical significance with increases in clinical severity 
as well. 

As can be noted in Appendix I, part of the output of the 
BMDP preference pairs program is a computation of scores based 
on judgments evaluated for each case" , the clinical case 
scores based upon the individual and "average" dentist's 
assessments and preferences . The clinical case scores for 
the "average" dentists are those of primary interest in 
construction and development of an oral health status index. 

As can be noted in Appendix I, the 66 clinical case scores 
developed for the "average" dentist range from -3.36 (-3.35518) 

to -10.54 (-10.53981) , with a mean of -7.29 (-7.2880591) and 

a standard deviation of 1.5 (1.4996847) . Of the 66 clinical 
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case scores, 96.97 percent (64/66) of the absolute values 
were less than 10.00. 

As in the work of Marcus et al., an oral health index with 
a maximum score of 100, indicating complete oral health, was 
desired primarily for aesthetic reasons. Concern that negative 
values might also be obtained was minimal, particularly con- 
sidering the differences between the population of interest 
within the uniformed services health benefits program and the 
population serviced by the UCLA dental school (to be discussed 
later) . Consequently, the clinical case scores obtained from 
the BMDP preference pairs program (see Appendix I) were multi- 
plied by a constant value (ten), and the variables contained 
within the data base for the 66 clinical cases (see Appendix 
H) regressed against the products using the multiple regression 
methodology available through the Minitab system developed at 
Penn State. [Ref. 309: pp . 166-171] As can be seen in Table 
12, the equation's y-intercept was essentially zero (-0.0007935) 
and the order of the Beta-coefficients was preserved (as expec- 
ted when multiplying by a constant) , with missing teeth and 
free-ends, decayed teeth, replaced teeth, periodontal pocket 
depths 2-3.9 mm, periodontal pocket depths 4-5.9 mm, and 
periodontal pocket depths 6+ mm, having Beta-coefficients of 
-3.8 (-3.279975891), -0.15 (-0.152220916), 1.34 (1.34132), 

-1.97 (-1.965415), -2.33 (-2.32565402), and -3.45 (-3.45111465), 
respectively . 
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TABLE 12 



RESULTS OF MULTIPLE REGRESSION OF SEVEN VARIABLES 
AGAINST ORAL HEALTH STATUS INDEX SCORES OF 66 
CLINICAL CASES. 



Vari able 


Variable Name 




B-Coef f icient 




I ntercept 




-0.0007935 


XI* 


Case Number 






X2 


Missing Teeth and Free Ends 


-3.279975891 


X3 


Decayed Teeth 




-0.152220916 


X4 


Replaced Teeth 




1.34132 


X5 


Periodontal Pockets, 


2-3.9 mm 


-1.965415 


X6 


Periodontal Pockets, 


4-5 . 9 mm 


-2.32565402 


XI 


Periodontal Pockets, 


6+ mm 


-3.45111465 



*Case label only, not involved in regression. 



To provide a numerical score for the oral health status 
index, the variables for each of the clinical cases are 
multiplied by their respective Beta-coefficients, summed, and 
the total subtracted from 100. The scores of the index of 
oral health for each of the 66 clinical cases are calculated 
and shown in Table 13. As can be seen, the final scores 
ranged from -5 (-5.398) to 66 (66.448) , with a mean of 26 

(26.204) , a median of 26 (26.949) , and a standard deviation 

of 12 (12.443) . 

To use this oral health status index on new clinical 
cases, similar procedures are employed. The number of missing 
teeth and f ree-ends ; decayed teeth; replaced teeth; and 
periodontal pocket depths of 2-3.9 mm, 4-5.9 mm, and 6+ mm, 
are first ascertained through clinical examination. The 
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totals for each of these clinical categories are totaled, 
multiplied by their respective weights (Beta-coefficients) , 
and the sums subtracted from 100 to yield the index score. 

Eight-two individuals (active and retired military 
personnel) were examined at the Naval Postgraduate School 
(NPS) by Navy Dental Corps officers, the oral health status 
of each assessed, and oral health status index scores 
calculated. As can be seen in Table 14, the final scores 
ranged from 40 (40.247) to 100, with a mean of 91 (1.354), 
a median of 99 (99.391) , and a standard deviation of 15 
(15.470) . 

Welch's approximation for the t' statistic was computed 
using the statistics (mean, variance, and number of observa- 
tions) derived from the clinical case scores of the two 
populations (UCLA patient sample, 66 cases, and NPS patient 
sample, 82 cases) and, as might be expected from even a 
casual examination, the two populations are statistically 
distinct from one another (with a t' statistic of 28.388) at 
virtually any level of statistical significance. [Ref. 310: 
pp . 298-299] This fact may be a significant factor in the 
development, construction, and implementation of an oral 
health index for any population, a factor to be discussed 
later . 

The evaluation of Marcus and his coworkers' direct oral 
health status index has provided significant findings for 
subsequent research and development of oral health indexes, 
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TABLE 13 



ORAL HEALTH STATUS INDEX SCORES FOR UCLA 
PATIENT SAMPLE OF 66 CLINICAL CASES. 



Case No. Index Score Case No. Index Score 



1 


30.95 


2 


30.65 


3 


15.72 


4 


29.13 


5 


36.83 


6 


20.90 


7 


19.55 


8 


29.00 


9 


36.66 


10 


32.87 


11 


66.44 


12 


50.55 


13 


37.21 


14 


24.15 


15 


32.70 


16 


38.44 


17 


34.64 


18 


43.65 


19 


27.21 


20 


-5.39 


21 


7. 76 


22 


38.23 


23 


30.91 


24 


27.32 


25 


23.55 


26 


32.56 


27 


26.77 


28 


34.34 


29 


37.34 


30 


34.20 


31 


10.53 


32 


26.38 


33 


9.14 



34 


31.58 


35 


38. 73 


36 


30.13 


37 


26.29 


38 


40.26 


39 


8.40 


40 


38.55 


41 


-0.30 


42 


26.94 


43 


24.02 


44 


26.97 


45 


33 . 66 


46 


36.05 


47 


40.41 


48 


30.97 


49 


14.03 


50 


25.86 


51 


13.24 


52 


24.13 


53 


12. 76 


54 


2 5. 68 


55 


3.42 


56 


20.27 


57 


9.93 


58 


10.91 


59 


7.13 


60 


24.29 


61 


26.40 


62 


40.57 


63 


16.06 


64 


20.26 


65 


13.99 


66 


16.72 



Number of observations = 66 
Mean = 26.204 
Median = 2 6.94 9 
Standard deviation = 12.443 
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TABLE 14 



ORAL HEALTH STATUS INDEX SCORES FOR NPS 
PATIENT SAMPLE OF 82 CLINICAL CASES . 



Case 


I ndex 


C ase 


I nd ex 


Case 


I nd ex 


No. 


Score 


No. 


Score 


No. 


Score 


i 


63.89 


29 


99.39 


57 


100.00 


2 


82.83 


30 


85.81 


58 


100.00 


3 


96.72 


31 


86.72 


59 


100.00 


4 


96.72 


32 


83.18 


60 


100.00 


5 


93.44 


33 


99.39 


61 


100.00 


6 


90.69 


34 


69.92 


62 


100.00 


7 


40.24 


35 


96.26 


63 


100.00 


8 


99.84 


36 


96.41 


64 


100.00 


9 


99.84 


37 


96.41 


65 


100.00 


10 


83.01 


38 


93.44 


66 


100.00 


11 


77.38 


39 


22.90 


67 


100.00 


12 


79.01 


40 


72.84 


68 


100.00 


13 


75.51 


41 


99.39 


69 


100.00 


14 


99.84 


42 


98.93 


70 


100.00 


15 


93.28 


43 


63. 63 


71 


100.00 


16 


91.98 


44 


91.34 


72 


100.00 


17 


99.54 


45 


98.93 


73 


100 .00 


18 


96.56 


46 


99.54 


74 


100 . 00 


19 


93.34 


47 


99.93 


75 


100.00 


20 


96.56 


48 


100.00 


76 


100.00 


21 


79.82 


49 


100.00 


77 


100.00 


22 


88.48 


50 


100.00 


78 


100.00 


23 


75.75 


51 


100.00 


79 


100.00 


24 


97.90 


52 


100.00 


80 


100.00 


25 


66.88 


53 


100.00 


81 


100.00 


26 


70.95 


54 


100.00 


82 


100.00 


27 


78.18 


55 


100.00 






28 


28.30 


56 


100.00 







Number of observations = 82 
Mean = 91.354 
Median = 99.391 
Standard deviation = 15.470 



particularly within the military health services sector. 
These findings are addressed within the following chapter. 
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V. FINDINGS AND CONCLUSIONS 



A. ORAL HEALTH STATUS INDEX 

The oral health status index, as developed by Marcus et 
al. [Ref s. 2 85-29 3 ] , and currently configured, appears inade- 
quate for use as a Navy oral health status index for a number 
of reasons. 

1 . Sampling Problems 

When evaluating the applicability of the oral health 
status index for assessing the oral health status of military 
personnel, a significant problem arises as a result of the 
sample population selected for its development. 

The population, from which the patient sample was 
drawn, was composed of patients examined and treated at the 
Veterans Administration Hospital, Los Angeles; Public Health 
Service Hospital, Los Angeles; and University of California 
at Los Angeles Dental School. 

This patient sample is significantly different from 
that encountered within the patient population served by the 
Navy, as can be seen by examining the data presented within 
Tables 13 and 14. As noted previously, the two populations 
are statistically distinct from one another, as determined 
by Welch's approximation for the t' statistic, at virtually 
any level of statistical significance ( t ' statistic of 28.388) 
[Ref. 310: pp. 298-299] 
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The fact that dental health professionals apparently 



use different factors (variables) in assessing the oral health 
status of different populations was pointed out by Marcus et 
al. and Koch et al. during development of the direct adult oral 
health status index and the children's oral health status 
index, respectively. [Ref. 285-293] 

As can be seen by examination of the direct oral 
health status index adult examination form in Figure 4, and 
the children's oral health status index examination form in 
Figure 5, the variables comprising each index, as well as 
their clinical importance (Beta-coefficients (8) or weights), 
are different. The direct adult oral health status index 
considers missing teeth (8 = -3.13) , free ends (8 = -3.13) , 
replaced teeth (8 = +0.61) , decayed teeth (8 = -1.79) , 
periodontal pockets 4-6 mm (8 = -0.73) , and periodontal 
pockets 6+ mm (8 = -3.02) . [Ref. 292: p. 729] The children's 
oral health status index, however, considers missing teeth, 
anterior primary (8 = -2.27) , posterior primary (8 = -4.55) , 
and all secondary (8 = -4.55) ; decayed teeth, anterior 

primary (8 = -1.22) , posterior primary (8 = -2.24) , and all 

secondary (8 = -.2.24) ; occlusion (8 = -4.38) ; and abnormal 

position (8 = -1.73) . [Ref. 293: p. 39] 

In a situation where the population of interest is 
significantly different from that for which the index was 
developed, as it is in this case, the applicability of the 
index must be considered questionable. 
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PATIENT I.Dj 
BIRTH OATE: 



DIRECT ORAL HEALTH STATUS INDEX 
ADULT EXAMINATION FORM 



DATE: 

EXAMINER: 







Tooth 

# 


T**th 




8on« 

4-6mm 


i COM 
6+mm 




R 


1 


M 


R 


0 


N 


C 










s 


2 


f 


R 


D 


N 


C 










6 


3 


p 


R 


0 


N 


C 










0 


4 


M 


R 


0 


N 


C 










R 


5 


M 


R 


D 


N 


C 












8 


M 


R 


D 


N 


c 








p 


A 

N 


7 


M 


R 


0 


N 


c 








E 

« 


T 

E 


8 


M 


R 


0 


N 


c 








A 


R 


9 


M 


R 


0 


N 


c 








C 


R 


10 


M 


R 


0 


N 


c 












11 


M 


R 


o- 


N 


c 










P 


12 


M 


R 


0 


N 


c 










0 

S 


13 


M 


R 


D 


N 


c 










E 


14 


F 


R 


0 


N 


c 










O 


15 


£ 


R 


0 


N 


c 










R 


16 


M 


R 


0 


N 


c 










P 


17 


M 


R 


0 


N 


c 










0 

s 


18 


t 


R 


D 


N 


c 










E 


19 


I 


R 


0 


N 


c 










0 


20 


M 


R 


0 


N 


c 










R 


21 


M 


R 


0 


N 


c 












22 


M 


R 


0 


N 


c 








l 

0 


N 


23 


M 


R 


0 


N 


c 








E 

» 


T 

E 


24 


M 


R 


D 


N 


c 








A 


R 


25 


M 


R 


D 


N 


c 








R 

C 


0 

R 


28 


M 


R 


0 


N 


c 












27 


M 


R 


0 


N 


c 










P 


28 


M 


R 


0 


N 


c 










O 

a 


29 


M 


R 


0 


N 


c 










T 

E 


30 


f 


R 


0 


N 


c 










O 


31 


1 


R 


0 


N 


c 










R 


32 


M 


R 


D 


N 


c 









LEGEND: 

M = missing 
R - replaced 
D = decayed 
N = normal 
C = space closure 
FE = free end 



TALLY 





* 


Coeff 


Subtotal 


MAXIMUM 






100.00 


Missing 




-313 | 




Free Ends 




-3.13 




Replaced 




♦0.61 




Decayed 




-1.79 




4-6 mm 




-0.73 




6-*- mm 




-3.02 




INDEX 









Figure 4. Direct oral health status index adult 
examination form. 
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CHILDREN S ORAL HEALTH STATUS INDEX 
EXAMINATION FORM 



PATIENT I.D. OATE: 

BIRTH DATE: EXAMINER I.D. 



OCCLUSION: 

CROSSSITE 

overbite 

OVERJET 

PROFILE 

LIPS 



• 1« ANT 1* POST 2« ANT 2* POST NONE Q 

•EXCESS ( >4mm) OPEN(<-1) NA □ NORMAL (-1 to 4mm) □ TOTAL 

• EXCESS ( >4mm) ASSENT (< 1mm) NA □ NORMAL (14mm) □ OCCLUSAL CHECKS 

■ CONCAVE STRAIGHT/CONVEX □ 

• INCOMPETENT NORMAL □ 



abnormal POSITION 

SPACE LOSS UPPER anT UPPER POST LOWER ANT LOWER POST. _ 

CROWOING 1* » UPPER ANT UPPER POST LOWER anT LOWER POST 

CROWOING 2* » UPPER ANT UPPER POST LOWER ANT LOWER POST 



NAO 

na a 

- NAQ 





PRIMARY 




PERMANENT 






AP 


Teeth 


Tooth * 




Tooth a 


Teeth 


AP 


| mi» tunic 


p 

0 

S 

T 










2 


M D S 












3 


M 0 S 






M D S 


A 




4 


M 0 S 






M 0 S 


9 




5 


M D S 




A 

H 

T 




M D S 


C 




S 


M D S 






M 0 S 


0 




7 


M D S 






M D S 


E 




3 


M D S 






M 0 S 


F 




9 


M D S 






M D S 


G 




10 


M 0 S 






M 0 S 


H 




11 


M D S 




P 

0 

s 

T 




M D S 


1 




12 


M D S 






M 0 S 


J 




13 


M D S 












14 


M D S 












IS 


M D S 




L 

0 

E 

n 

C 


P 

0 

s 

T 










IS 


M D S 












19 


M 0 S 






M D S 


K 




20 


M D S j 






M 0 S 


L 




21 


M D S j 




A 

T 




M D S 


M 




22 


M 0 S j 






M D S 


N 




23 


M D S | 






M D S 


0 




24 


M 0 S 






M 0 S 


P 




25 


M 0 S 






M D S 


0 




26 


M D S 






M D S 


R 




27 


M 0 S 




P 

0 

3 




M D S 


S 




28 


M D S 






M D S 


T 




29 


M D S 












30 


M D S 












31 


M D S 





LEGEND 

M • Missing 
D • Decayed 
S » Sound 

AP * Abnormal Pontlon 
(rotated, displaced, 
tipped, ankylosed. 
ectopic) 



TALLY 





# 


Coeff 


Subtotal 


MAXIMUM 






100.00 


1* Ant 
M 




-2.27 




1* Post 
2° All 




-4.55 




1° Ant 
n 




-1.22 




1° Post 
2* All 




-2.24 




Occlusion 




-4 38 




Abnormal 

Position 




-1.73 




INDEX 









Figure 5 . 



Children's oral health status index 
examination form. 
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2 . 



Statistical Problems 



There appear to be a number of problems, primarily 
related to the use of statistical procedures and manipulations, 
involved in the oral health status index's development, con- 
struction, and application, that render the validity of the 
index questionable. 

First, although the stated purpose for the development 
and construction of the oral health status index was to identi- 
fy "the decision factors that correspond, in a statistical 
sense, to the quantitative framework of the dentists' judgments," 
Marcus and his coworkers introduced potential bias by assigning 
clinical "severity weights" to all variables (See Figure 6) . 

These clinical severity weights were not made availa- 
ble to the dentists performing the paired preference experiment 
but were used to transform the raw data within each clinical 
case prior to use in the BMDP preference pairs statistical 
software program. [Ref. 285: pp . 28-29] 

The resulting Beta-coefficients (clinical weights) , 
consequently, reflected not only the interactions between the 
dentists' preferences and the variables involved in each of 
the cases, but a systematic bias introduced by transforming 
the raw variables through multiplication by the assigned 
clinical severity weights. 

Second, although the final adult oral health index 
uses only the total number of teeth for each of the clinical 
categories (variables) , during the development and construction 
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CASE ABSTRACTION FORM 



Figure 



Case No. Age Sex: Male Female 



Race : 



American Indian 


(1) 


Health: Diabetes 


Black 


(2) 


Cardiovascular 


Oriental 


(3) 


Rheumatic Fever 


Spanish 


(4) 




White 


(5) 




Other (Specify) 


(6) 


( ) 



TMJ 




Occlusion 


Sounds 


l 


Class 


I 


Dislocation 


1,5 


Class 


II 


Function Loss 


5 


Class 


III 


Pain 


7 







Crossbite 

Anterior X 

Posterior ^ 



Gingivitis 
Acute n 
Chronic Q 





Upper 


Lower 




Ant . 


i'OSt . 




FOSL. 


Total 


Extruded 


Severe 


1 


T 


1 


1 




Abrasion 


Severe 


_ _ 1 


1 


1 


_ _1 . 


. 2. 


Fracture 


Mild 


1 


1 


1 




7 


Severe 


S 


7 


6 


7 


1 .. 


Periapical 


4 


3 


5 


3 


5 


Unerupted 




... 3 


_ 1 


3 _ 


1 


6 


Missing 


Total* 


1 


1 


1 


1 


7 


Cuspid/lst Molar 


2 


1 


2.5 


L_ 


8 


Free Ends 


0 


4 




5 


9 


3rd Molar 


o- 


0 


r 


0 


10 


Tipped Teeth 




n 


1 


IT 


1 


11 


Virgin 

Decay 


Mild 


1 


1 


1 


1 


12 


Severe 


3 


2.5 


3_5 


2.5 


1 3 


Pulpal 


6_ 


.5.5 


7 


5.5 


14 


Recurrent 

Decay 


Mild 


1.5 


1.5 


1.5 


1.5 


15 


Severe 


4 


3.5 


4.5 


. . 3.5 


16 


Pulpal 


6 


5.5 


7 


5.5 


1 7 


Fillings 

(Direct) 


Serviceable 


1 


1 


1_ 


1 


18 


Detective 


4 


4 


4 


4 


19 


Restorations 
(Cast ) 


Serviceable 


1 


1 


1 


1 


-20 


Defective 


6 


6 


6_ 


6 


21 


Endodontics 


Serviceable 


1 


1 


1 


1 


22 


Defective 


6.5 


6 


6.5 


6 


23 


Tumors 




. 1. 


l 




1 


24 


Replaced 


Fixed Pontics 


1 


1 . 


.. 1 


1 _ 


25 . 


Removable 


3.5 


7 


3 


2 5 


26 


Calculus 






. 1 


_ 1 


1 


7 7 


Bone Loss 


Mild (<l/3) 


1.5 


1.5 


1.5 


1.5 




Moderate (i/3-1/2) 


1 4.5 


4.5 


4.5 


4.5 


np 


Severe 01/2) 


8. 


8 


8 


a 


30 


Pockets 


0 to 1.9 mm 


1 


1 


1 


i 


31 


2 to 3.9 mm 


1 


1 






7? 


4 to 5.9 mm 


4 


4 . . 


4 


.4 


33 


6+ mm 


6 


_ 6 _ 


6 


6 


34_ 


Mobility 


Class I 


P 


p 


7 


2 


7q 


Class II 


5. 


5 . 


5 


A 


36 


Class III 


10 


- io 


. IQ 


in- 


7 7 



•Total does not include wisdom teeth. 



Clinical severity weights as assigned by 
Marcus et al . during development of the 
oral health status index. 
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of the index, "most of the adult variables were transformed 
from absolute numbers to percentages for inclusion into the 
paired preference program." [Ref. 285: p. 28] 

Beta-coefficients (clinical weights) of index variables 
were generally derived from the use of three different deter- 
minants: (1) the number of teeth within each clinical category, 

divided by the total number of teeth present in the patient's 
mouth, and expressed as a percentage; (2) the variables' 
respective clinical "severity weights", and (3) the preferences 
of the dentist consultants. 

The use of the resultant Beta-coefficients within the 
final adult oral health index, however, is predicated on only 
the total number of teeth within each of the clinical categories. 
Neither the percentages of teeth present nor assigned "severity 
weights" are involved in calculation of the index. 

The problem in terms of the index's validity, lies in 
the fact that the index is being used to measure some factor 
other than that for which it was developed. 

Third, the clinical case scores, against which all 
subsequent multiple regressions were performed in developing 
the oral health status index, were obtained by processing the 
clinical cases containing 18 variables through the BMDP pref- 
erence pairs program. [Ref. 289: p. 77] Subsequent multiple 
regressions performed in attempting to develop a model for the 
oral health status index, regardless of which of the clinical 
variables were involved, or the number of clinical variables 



used, all had one fact in common. All equations were 
regressed against the same clinical case scores, those 
obtained during the original regressions of the equation 
containing 18 variables. Thus, the clinical scores used 
in all subsequent regressions in the development of the 
model for the oral health status index were not a function 
of the variables in the equation being regressed, which 
would have made the equations internally valid, but were 
a function of a different regression equation, one composed 
of 18 variables. 

Fourth, the choice of variables to be included 
within the final oral health index was based on somewhat 
arbitrary selection by Marcus and his coworkers rather than 
on purely statistical evidence. For example, the five 
variables selected for inclusion within the final index 
were not those variables with the greatest statistical 
significance, as suggested by t-values , but were the result 
of the researchers reaching a "strong consensus" on which 
variables should have been included within the final index. 
[Ref. 285: p. 78] 

Fifth, there were a number of statistical manipula- 
tions performed, considered by Marcus and his coworkers to 
be "extremely informative" , which appeared to be of ques- 
tionable value. 

For example, each of the total variables (the sum of 
the four positional variables) "was regressed on its locational 
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subcomponents (the four positional variables) ... in order 
to find more expedient ways to capture the quantitative 
information held in the whole variable." Recalling that 
the total variable of each clinical category was merely the 
sum of its positional components multiplied by arbitrarily 
assigned clinical severity weights, the value of such a 
regression in determining which variables should have been 
retained and which should have been discarded was questionable. 
This was particularly true when emphasis was put on statistics 
such as Beta-coefficients, t-values, and R-square values, 
resulting from such statistical procedures. 

There were enough of these problems in the development 
and construction of the oral health status index that the 
statistical validity of the index should have been considered 
ques tionab le . 

B. PROBLEMS ENCOUNTERED IN DEVELOPMENT OF A MODEL 

The work described in the previous chapter was accomplished 
primarily to resolve a number of the problems inherent in 
Marcus and his coworkers ' oral health status index described 
above. A number of findings of interest resulted from this 
exercise . 

1 . Sampling Problems 

Since the same clinical cases and initial data base 
were used, the sampling problems described above will continue 
until an applicable population is sampled and a new data base 
created . 
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2 . The BMDP Preference Pairs Program 



The BMDP preference pairs program [Ref. 300-301] 
appears to be a powerful statistical software program. As 
a precautionary note, however, what it does, and how it is 
accomplished, need to be understood by those using it. 

Initial outputs of BMDP preference pairs programs 
were at times confusing. As early runs were reviewed, 
particularly those runs with less than 43 variables, it was 
noted that the program had predicted zero scores for every 
clinical case for some dentists, with subsequent zero 
correlations between those dentists and all other dentists, 
including themselves. 

Further examination of the output printouts, however, 
revealed several consistent findings in these situations. 

First, the model developed for each dentist (producing 
zero scores and correlations) through the multiple regression 
phase of the preference pairs program consistently had only 
one variable. Although the variable could be any of the 
possibilities for that particular set (208, 43, 14, or 7 
variables) , there was only one variable in the final step 
(always the first step) . 

Second, for every case within the data base, scores 
based on those particular dentists' judgments were always 
zero . 

Third, correlations between case scores were always 
zero for any clinical case which involved that particular 
dentist . 
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Cases were also found, however, that revealed the 



first finding (only one variable) , but failed to produce the 
problems encountered within the second and third findings 
(zero scores and zero correlations between scores, respectively) 

Subsequent experience with the BMDP preference pairs 
program revealed that this particular problem could be alle- 
viated by changing the t-values used within the multiple 
regression phase of the program. Default t-values for the 
program were 2.0 (TENTER = 2.0, TREMOVE = 2.0) [Ref. 300: 
p. 553] but were capable of being altered as desired. 

Subsequent runs of the program included t-values of 

2.0, 1.0, and 0.0 (TENTER = 2.0, 1.0, and 0.0; TREMOVE = 2.0, 

1.0, and 0.0) and provided more interesting results. Since 
the final model, containing seven variables, was of primary 
interest in development of the index, all three runs of the 
preference pairs program (TENTER-, TREMOVE- values 0.0, 1.0, 
and 2.0) were provided in Appendices I, J, and K, respectively. 

The effects of altering the t-values (TENTER, TREMOVE) 
within the BMDP preference pairs program can be seen by 
examining Appendices I, J, and K. As can be seen, multiple 
effects resulted. 

As the t-values (TENTER, TREMOVE) were increased from 
0.0 to 2.0, the number of steps, and consequently the number 
of variables, within the multiple regression portion of the 
program generally decreased. 

On the other hand, as the t-values (TENTER, TREMOVE) 
were increased from 0.0 to 2.0, the R-squared values generally. 



but not always, decreased. Of particular interest, the two 
dentists (judges 2 and 5) for whom the preference pairs 
program yielded zero correlations when the t-values (TENTER, 
TREMOVE) were 2.0, revealed decreased R-squared values when 
the t-values (TENTER, TREMOVE) were increased from 0.0 to 1.0, 
but increased R-squared values when the t-values (TENTER, 
TREMOVE) were increased from 1.0 to 2.0. 

At a minimum, these findings should encourage at least 
some caution in interpreting and comparing findings from 
different regression models, or even the same regression 
model under different levels of significance, evaluated 
through the BMDP preference pairs program. As noted above, 
this should be particularly true of t-values (B/SEB) , R-squared 
values, and correlations of dentists' case scores. 

C. DEVELOPMENT OF THE MODEL 

The initial 208 variables, as originally abstracted from 
the clinical cases, were obviously too cumbersome to provide 
a functional oral health index. Factor analysis, as described 
in the previous chapter, provided a means of grouping certain 
of these variables into factors (groups of variables) which 
seemed to provide the greatest explanatory power for the 
dentists' preferences. This procedure was utilized successive- 
ly for reductions from 208 variables, to 43 variables (factors), 
to 14 variables (factors) and to seven variables (factors) . 

The results of the factor analyses seemed to be rational 
from a clinical diagnostic point of view as well as from a 
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statistical point of view. For example, the initial factor 
analysis procedure (on 208 variables) revealed that the 
greatest explanation for the dentists ' preference could be 
obtained by using only the total number (the sum of the 
positional variables) of teeth involved within each clinical 
variable, a fact that seemed to make clinical sense, particu- 
larly when one viewed the somewhat confusing Beta-coefficients 
for the positional variables obtained earlier (with 208 
variables) from the BMDP preference pairs program. 

Additionally, as the number of variables (factors) were 
further reduced to 43, 14, and finally seven variables 
(factors), the groupings continued to be rational from a 
clinical diagnostic point of view as well as a statistical 
point of view. For example, the decay variable ultimately 
came to include the totals of fractured teeth (mild, severe, 
and periapical) , virgin decay (mild, severe, and pulpal) , 
recurrent decay (mild, severe, and pulpal), defective fillings, 
defective restorations, and defective endodontics, combinations 
which seemed to be appropriate clinically. This was true for 
all of the seven variables (factors) within the final model. 

Moreover, other statistics of interest revealed expected 
movement as the number of variables (factors) were reduced 
from 208, through 43 and 14, to seven. First, the t-values 
(B/SEB) of each of the variables (factors) increased as the 
number of variables decreased. Second, the R-squared values 
decreased concomitantly with the decrease in the number of 
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independent variables within each regression model. 

[Ref. 299: p. 78] 

Lastly, the Beta-coefficients of all seven variables 
(factors) in the final model seemed intuitively and clinically 
appropriate. The Beta-coefficients of all variables were 
appropriate in direction in regard to oral health status, 
with missing teeth, decayed teeth, and abnormal periodontal 
pocket depths (0-3.9 mm, 4-5.9 mm, and 6+ mm) negatively 
related to oral health, and replaced teeth positively related 
to oral health. 

D. DEVELOPMENT OF THE INDEX 

As noted in the previous chapter, the final model developed, 
with its seven variables (factors) , provided the basis for the 
oral health status index. This oral health status index, with 
its variables and Beta-coefficients, was provided within Table 
12 . 

Interestingly enough, with one exception, the variables 
included within the oral health status index were the same 
as those selected by Marcus et al . As can be seen by examining 
the data within Table 15, which compares the final oral health 
status index developed by Marcus and his coworkers with that 
developed within this thesis, with the single exception of 
periodontal pockets, 2-3.9 mm, the variables included are the 
same. The Beta-coefficients of these variables, however, differ 
significantly . 
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TABLE 15 



COMPARISON OF ORAL HEALTH STATUS INDEXES 
DEVELOPED BY MARCUS ET AL . AND WITHIN 
THIS THESIS . 



Beta-Coef f icients 



Variable Name 


Marcus et al. 


Thesis 


Missing Teeth and 
Free Ends 


-3.13 


-3.28 


Decayed Teeth 


-1.79 


-0.15 


Replaced Teeth 


+0.61 


+1.34 


Periodontal Pockets, 
2-3.9 mm* 




-1.97 


Periodontal Pockets, 
4-5.9 mm 


-0.73 


-2.33 


Periodontal Pockets, 
6+ mm 


CM 

O 

CO 

1 


-3.45 



x 



*Not included in the oral health status index of Marcus et al. 
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With the obvious differences, as noted within the 
previous chapter, in the use of statistical procedures by 
Marcus and his coworkers and as used within this thesis, 
this finding was not unexpected. Neither was it easily 
explained, however. The differences were manifold and 
comparisons may be of limited value. 

E. SUMMARY OF CONCLUSIONS 

First, the oral health status index, as developed by 
Marcus and his coworkers should not be applied to the general 
population served by the health benefits program of the 
uniformed services. 

Second, the BMDP preference pairs program is a powerful 
statistical tool. If used thoughtfully, this program is 
capable of developing a mathematical model, revealing the 
importance (statistical weight) attributed to each diagnostic 
variable within the model, as pairs of clinical cases are 
assessed to determine their relative levels of oral health. 

Third, using the output of the BMDP preference pairs 
program, and a carefully selected population sample, it is 
possible to develop an oral health status index that is 
valid and meaningful for the general population served by 
the health benefits program of the uniformed services. 

Fourth, an oral health index, developed for use within 
the uniformed services, can be a powerful tool in evaluating 
unmet needs of eligible benficiaries ; assessing the quality 
of care provided to beneficiaries; determining the effectiveness, 
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efficiency, and productivity of providers in providing care 
to beneficiaries; determining optimal allocation of limited 
health care resources; and in accomplishing a wide range of 
health care planning activities, including manpower, resource, 
and budgetary. 

There remains, however, essential work to be done, with 
this in mind, recommendations for future endeavors in 
developing an oral health status index are addressed within 
the following chapter. 
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VI . RECOMMENDATIONS 



A. CONTINUE DEVELOPMENT OF ORAL HEALTH INDEX 

Further work on development of an oral health index, 
applicable to the health benefits program of the uniformed 
services, should be continued. In particular, populations 
of health care providers, managers, planners, and other 
decision makers, as well as patients, which reflect the 
constituency of the health benefits program supported by 
the Navy need to be sampled adequately to provide a basis 
for subsequent research and development of an oral health 
index. 

B. EXPAND THE SCOPE OF THE ORAL HEALTH INDEX 

The development of the oral health index should be 
expanded in scope, to include not only the emphasis and 
priorities of clinical dentists, but to include the priorities 
and concerns of health care managers, planners, and other 
decision makers as well. 

To be successful in evaluating health care system concerns 
such as effectiveness, efficiency, and productivity, an oral 
health index must reflect the values of all significant health 
care professionals within the health care system, including 
health care providers, managers, planners, and other decision 
makers . 
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For example, the assessment of oral health and treatment 
needs by health care providers may be a function of the 
clinical status of oral tissues and structures, general 
physical health, presence of specific pathologic entities, 
prognosis, age, sex, race, social status, etc., of the patient. 
The assessment of oral health and treatment needs by managers, 
planners, and other decision makers, however, may also involve 
such factors as the level of needs within the population of 
interest, the cost of various treatment alternatives, the 
resources available to cope with such alternatives, current 
laws and regulations pertaining to the provision of care, etc. 

C. EVALUATE METHODOLOGIES USED IN DEVELOPMENT OF INDEXES 

A number of basic concerns regarding methodologies 
employed in the development of oral health indexes need to 
be resolved. 

The manner in which clinical data and information are 
presented to health care experts needs to be evaluated 
further. There are a number of experimental effects that 
may occur as a result of the experimental methodology itself, 
and where these occur, they need to be identified. A few 
of the major questions to be addressed include the following: 

What are the effects of providing photographs and histori- 
cal data of patients, from which the sex, race, age, and other 
social and demographic characteristics may be ascertained, on 
the assessment of oral health. 
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Do health care providers, managers, planners, and 
decision makers give greater importance to certain clinical 
conditions when they are found within some demographic groups 
than when they are found in others? 

Are certain clinical oral conditions given greater 
significance when they occur within certain occupational 
groups, such as aviators or divers, than when they occur 
within the general population? 

Are, or should, different beneficiary groups, such as 
active military, retired military, or dependent personnel, be 
evaluated differently in regard to oral health and significance 
of oral pathology than are other categories of beneficiaries? 

D. EVALUATE DECISION MODELS OF HEALTH CARE PROFESSIONALS 

Additional research needs to be accomplished to more 
fully understand the decision making models used by health 
care providers, managers, planners, and decision makers. 

Do dental care providers, for example, base severity of 
decay on the total number of teeth affected with carious 
lesions, the ratio of decayed teeth to the total number of 
teeth present within a patient's mouth, the location of the 
decayed teeth within the patient's mouth, or some other 
model of clinical assessment. 

How do health care prqviders, managers, planners, and 
decision makers measure effectiveness, efficiency, and 
productivity within the health care system? What are the 
variables of importance? The change in the overall health 
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of the individual; the change in the overall health status 
of a beneficary population; the number of patients treated; 
the number of procedures accomplished; the resources utilized; 
or some other factor or group of factors? 

E. EVALUATE ALTERNATIVE METHODOLOGIES 

Alternative methodologies, such as expert systems should 
be evaluated for their applicability in developing models of 
the decision making processes of health care providers, 
managers, planners, and other decision makers. 
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SCORES 8ASE0 ON JUOGMENTS EVALUATEO FOR EACH CASE. 
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SCORES BASED ON JUDGMENTS EVALUATEO FDR EACH CASE. 
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COEFFICIENTS OF LINEAR FUNCTIONS OF VARIABLES. PREFERENCE NAME=JUDGE 10 

STEP NUMBER 1 STEP NUMBER 2 STEP NUMBER 3 STEP NUMBER 4 STEP NUMBER 
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